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Abstract 

Gluon shadowing which is the main source of nuclear effects for production of heavy 
flavored hadrons, remains unknown. We develop a light-cone dipole approach aiming 
at simplifying the calculations of nuclear shadowing for heavy flavor production, as 
well as the cross section which does not need next-to-leading and higher order cor- 
rections. A substantial process dependence of gluon shadowing is found at the scale 
of charm mass manifesting a deviation from QCD factorization. The magnitude of 
the shadowing effect correlates with the symmetry properties and color state of the 
produced cc pair. It is about twice as large as in DIS but smaller than for charmo- 
nium production Q. The higher twist shadowing correction related to a nonzero size 
of the cc pair is not negligible and steeply rises with energy. We predict an appreciable 
suppression by shadowing for charm production in heavy ion collisions at RHIC and 
a stronger effect at LHC. At the same time, we expect no visible difference between 
nuclear effects for minimal bias and central collisions, as is suggested by recent data 
from the PHENIX experiment |41]. We also demonstrate that at medium high ener- 



gies when no shadowing is possible, final state interaction may cause a rather strong 
absorption of heavy flavored hadrons produced at large xp. 
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1 Introduction 



It is still unclear whether available data from fixed target experiments demonstrate any 
nuclear effects for open charm production [|T]-^. Naively one might expect no effects at 
all, since a heavy quark should escape the nucleus without attenuation or reduction of its 
momentum. In fact, this is not correct even at low energies as is explained below. Moreover, 
at high energies one cannot specify any more initial or final state interactions. The process 
of heavy fiavor production takes a time interval longer than the nuclear size, and the heavy 
quarks are produced coherently by many nucleons which compete with each other. As a 
result the cross section is reduced, and this phenomenon is called shadowing. 

In terms of parton model the same effect is interpreted in the infinite momentum frame 
of the nucleus as reduction of the nuclear parton density due to overlap and fusion of partons 
at small Bjorken x. The kinematic condition for overlap is the same as for coherence in the 
nuclear rest frame. 

There are well known examples of shadowing observed in hard reactions, like deep- 
inelastic scattering (DIS) [0 and Drell-Yan process (DY) demonstrating a sizeable re- 
duction of the density of light sea quarks in nuclei. Shadowing is expected also for gluons, 
although there is still no experimental evidence for that. 

Shadowing for heavy quarks is a higher twist effect, and although its magnitude is 
unknown within the standard parton model approach, usually it is neglected for charm and 
beauty production. However, this correction is proportional to the gluon density in the 
proton and steeply rises with energy. Unavoidably, such a correction should become large 
at high energies. In some instances, like for charmonium production, this higher twist effect 
gains a large numerical factor and leads to a rather strong suppression even at energies of 
fixed target experiments 0. 
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On the other hand, gluon shadowing which is the leading twist effect, is expected to be 
the main source of nuclear suppression for heavy flavor production at high energies. This is 
why this process is usually considered as a sensitive probe for the gluon density in hadrons 
and nuclei. If to neglect the power, I/itlq, corrections (unless otherwise specified), then the 
cross section of heavy QQ production in pA collision is suppressed by the gluon shadowing 
factor i?2 compared to the sum of A nucleon cross sections, 

ajf (xi,X2) = Ri{xi,X2)Aa^S{xx,X2) . (1) 

Here 

i?5(a;i,a;2) = j J d% R'Kx,, X2,b)TAib) , (2) 

where R'^{xi,X2,b) is the (dimensional) gluon shadowing factor at impact parameter b; 
TA{b) = J^oo dzpA{b,z) is the nuclear thickness function at impact parameter b; Xi, X2 are 
the Bjorken variables of the gluons participating in QQ production from the colliding proton 
and nucleus. 

Parton model cannot predict shadowing, but only its evolution at high Q^, while the 
main contribution originates from the soft part of the interaction. The usual approach is 
to fit data at different values of x and Q^ employing the DGLAP evolution and fitting 
the distributions of different parton species parametrized at some intermediate scale 
However, the present accuracy of data for DIS on nuclei do not allow to fix the magnitude 
of gluon shadowing, which is found to be compatible with zero []. Nevertheless, the data 
exclude some models with too strong gluon shadowing [Q. 

Another problem faced by the parton model is impossibility to predict gluon shadowing 
effect in nucleus-nucleus collisions even if the shadowing factor Eq. (|l]) in each of the two 
nuclei was known. Indeed, the cross section of QQ production in collision of nuclei A and 
B at impact parameter b reads. 



d?b 



R^s{xi,X2,b) AB (T%%{xi,X2) , (3) 



^Gluon shadowing was guessed in B to be the same as for F2{x, Q^) at the semi-hard scale. 
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where 

R%{xi,X2,b) = ^J d^sRi{xi,s)TA{s) R%{x2,h - s)TB{h - s) . (4) 

In order to calculate the nuclear suppression factor Eq. (|) one needs to know the impact 
parameter dependence of gluon shadowing, 6), while only integrated nuclear shadow- 

ing Eq. (0) can be extracted from lepton- or hadron-nucleus data|. Note that parton model 
prediction of shadowing effects for minimum bias events integrated over h suffers the same 
problem. Apparently, QCD factorization cannot be applied to heavy ion collisions even at 
large scale. The same is true for quark shadowing expected for Drell-Yan process in heavy 
ion collisions |TgHI3- 

Nuclear shadowing can be predicted within the light-cone (LC) dipole approach which 



describes it via simple eikonalization of the dipole cross section. It was pointed out in [13 



that quark configurations (dipoles) with fixed transverse separations are the eigenstates 
of interaction in QCD, therefore eikonalization is an exact procedure. In this way one 
effectively sums up the Gribov's inelastic corrections in all orders p^ . 

The advantage of this formalism is that it does not need any i^-factor, since effectively 
includes all higher twist and next-to-leading, next-to-next... corrections. Of course, one 
assumes universality of the dipole cross section, i.e. its process independence. This property 
can be proven in the leading log(l/a;) approximation, otherwise is an assumption of the 
model. Indeed, it was demonstrated recently in that the simple dipole formalism for 
Drell-Yan process [p^ p!5|, p!6| precisely reproduces the results of very complicated next- 
to-leading calculations at small x. The LC dipole approach also allows to keep under 
control deviations from QCD factorization. In particular, we found a substantial process- 
dependence of gluon shadowing due to existence of a semi-hard scale imposed by the strong 
nonperturbative interaction of light-cone gluons fl^. For instance gluon shadowing for 

charmonium production off nuclei was found in |^ to be much stronger than in deep-inelastic 
^One can get information on the impact parameter of particle- nucleus collision measuring multiplicity 
of produced particles or low energy protons (so called grey tracks). However, this is still a challenge for 
experiment. 
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scattering |[T7|1 . 



The LC dipole approach also provides effective tools for calculation of transverse mo- 
mentum distribution of heavy quarks, like it was done for radiated gluons in [IIB, Il8|, or 



Drell-Yan pairs in |Tl| . Nuclear broadening of transverse momenta of the heavy quarks also 



is an effective way to access the nuclear modification of the transverse momentum distribu- 



tion of gluons, so called phenomenon of color glass condensate or gluon saturation ||19|,pO|]. 
In this paper we consider only integrated quantities and leave the transverse momentum 
distribution for further calculations. 

In what follows we find sizeable deviations from QCD factorization for heavy quark pro- 
duction off nuclei. First of all, for open charm production shadowing related to propagation 
of a cc pair through a nucleus is not negligible, especially at the high energies of RHIC and 
LHC, in spite of smallness of cc dipoles. Further, higher Fock components containing gluons 
lead to gluon shadowing which also deviates from factorization and depends on quantum 
numbers of the produced heavy pair cc. 

This paper is organized as follows. In Sect. we consider the contribution of the lowest 
Fock component cc of projectile gluons to production of a cc pair in NN collisions. A LC 
representation is derived for three production amplitudes which are classified in accordance 
with the color and symmetry properties of the cc. We are focusing on charm for the sake of 
concreteness, but all the results of the paper are applicable to production of beauty. 

Multiple color-exchange interaction of a cc pair propagating through a nucleus are con- 
sidered in Sect. ^T^. The corresponding nuclear shadowing has a form of the conventional 



Glauber eikonal, where the exponent contains the dipole cross section (73 of interaction of a 
3-parton system ccG. 

Sect. 1^ is devoted to the problem of gluon shadowing. First of all, a dipole representation 
for the process GN ccGX is derived in Sect. [O] and [Appendix A| . Three types of 



amplitudes are found, one for production of a colorless cc and a gluon, and two for color- 
octet cc and a gluon, corresponding to two possible symmetries of an octet-octet state. 
The same reaction of gluon radiation accompanying cc pair production off nuclei is related 



to the phenomenon of gluon shadowing. It is described in Sect. p.2| employing the technique 
of hght-cone Green functions corresponding to propagation of a ccG system through nuclear 
matter. 

Light-cone gluons are known to have a short range propagation radius in the transverse 
plane which we describe via a nonperturbative light-cone potential in the Schrodinger two- 
dimensional equation for the Green function. The strength of the potential depends on 
the color state and symmetry of the ccG system. Correspondingly, the LC nonperturbative 



wave functions are also different. In Sect. |3.3| we find three types of LC wave functions with 
different mean separations. 

Naturally, gluon shadowing correlates with the size of the ccG, therefore it demonstrates 
a strong process dependence, i.e. deviation from QCD factorization. Different types of 



gluon shadowing calculated in Sect. are presented in Fig. HI. Since about 20% of cc pair 



are produced in a colorless state, it is important to know the fraction of such pairs which 
end up in an open charm channel. This estimate is done in Sect, |3.5| . 

The results of these calculations are used in Sect. |^ to predict nuclear shadowing for open 
charm production in proton-nucleus collisions. This includes gluon as well as charm quark 
shadowing, and also possible medium modifications like EMC effect and gluon antishadow- 
ing. We provide predictions of nuclear effects plotted in Fig. § for open charm production 
m p — W collisions at the energy of the HERA-B experiment. 

In the same Sect, ^jwe provide predictions for shadowing for charm production in heavy 
ion collisions at the energies of RHIC = 200 GeV) and LHC {^/s = 5500 GeV) depicted 
in Figs. §1 - 0- We found quite a sizeable contribution from the higher twist effect of 
shadowing related to size of the cc pair. A most interesting observation is nearly identical 
shadowing effects predicted for minimal bias and central collisions, what has been indeed 
observed recently by the PHENIX experiment at RHIC. We identify the source of such a 
coincidence, and emphasize that this observation should not be interpreted as an indication 
for weak nuclear effects. Indeed, Figs. ^ demonstrate a substantial nuclear shadowing even 
for RHIC. 
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In Sect. ^ we consider the case of medium high energies when noshadowing is possible 
since the coherence length is short. Then the cc pair is produced momentarily on a bound 
nucleon and then undergoes final state interactions. On the contrary to wide spread believe, 
we argue that these interactions lead to absorption related to an unusual configuration in 
which the heavy fiavored hadron is created. 

We summarize the results of calculations and observations in the concluding Sect. 



2 Light-cone dipole formalism for charm production 
2.1 NN collisions 

For the sake of concreteness in what follows we consider charm cc pair production, unless 
otherwise specified. Our results are easily generalized to the case of heavier quarks. The 
parton model treats this process in the rest frame of the produced pair as glue-glue fusion, 
GG cc. At the same time, in the rest frame of the nucleus it looks like interaction of a 
cc fiuctuation which has emerged from a projectile gluon. Thus, the problem is reduced to 
the process, 

G + N ^cc + X . (5) 

In the LC dipole approach the cross section is represented by a sum over different Fock 
components of the projectile gluon whose LC wave functions squared are convoluted with 
proper dipole cross sections. The cross section corresponding to Feynman graphs depicted 



in Fig. P was calculated in [21| and it was found that it needs a dipole cross section corre- 



sponding to a three-body system Gcc. This observation follows the general prescription [|I0 
that the partonic process a ^ be is related to the dipole cross section aabc{r, a) for the three- 
partonic abc system with transverse separations f (for the be), af (dc) and af (bd). Here a 
and a = 1 — a are the fractions of the light-cone momentum of the parton a carried by the 
partons b and c respectively (the notation used further on). The intuitive motivation for 
this prescription is rather transparent. The incident constituent parton a contains different 
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Figure 1: Perturbative QCD mechanism of charm production production 
in a gluon-nucleon coUision. Only the lowest cc Fock component of the 
gluon is taken into account. 



Fock components, the bare parton \a), the excitation \bc), etc. If the states \a) and \bc) 
had the same interaction amphtudes, no production process a ^ be would be possible, since 
the composition of the coherent Fock components which build up the constituent parton a 
remained unchanged. Thus, the production amplitude of a ^ 6c is proportional to the dif- 
ference of the interaction amplitudes fa — f{bc) which coincides with the scattering amplitude 
f{abc)- Remarkably, each of the amplitudes fa and f(bc) might be infra-red divergent (like in 
the case of G ^ cc), while f(abc) is infra-red stable due to color neutrality of the system. 

Treating the process Eq. (^) in more detail, one should discriminate between three differ- 
ent color and spin states in which the cc pair can be produced. These states are orthogonal 
and do not interfere in the cross section. They include: 

1. The color-singlet C-even cc state. The corresponding amplitude is odd (O) relative to 
simultaneous permutation of spatial and spin variables of the cc and has the form, 

kr, «) = E ^ Sae 5., O'riK, kT, «) . (6) 
e=l " 

Here k and fcy are the relative and total transverse momenta of the cc pair respectively; 

are spin indexes, a and i,j are color indexes of the gluon and produced quarks, 
respectively. We will classify such a state as 1~, which means a color singlet with odd 
parity relative to index permutation. Note the l"*" cannot be produced in the reaction 
Eq. (i. 
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2. Color-octet cc state with the production amphtude also antisymmetric relative simul- 
taneous permutation of spatial and spin variables of the cc (8~), 

Sg;(/?, kr, «) = E J daeg T.izj) OriK, kr, a) . (7) 

e,g=l ^ 

Here \g = Tg/2 are the Gell-Mann matrixes. 

3. Color-octet cc with the amplitude symmetric relative permutation of quark variables 
(8+), 

Ci^M kr, «) = E ^ faes Tgitj) Erin, kr, a) . (8) 
The amplitudes Eq. (|^) - contain the common factor 

0~^^{K,kT,a) = I d^dhe'^^'^-'^^-'^^ir) \-f^^\s - ar) - j^^^s + ar\\ , (9) 



which is odd (O) under permutation of the non-color variable of the quarks. Correspond- 
ingly, the even (E) factor in the amplitude Eq.(|^) reads, 

E^^'in, kr, a)= f d?r dh e''^''+'^^-' ^~^^{f) W^\s - ar) + -^^^\s + ar\ -2-^^^\s)\ , (10) 



Here s and r is the position of the center of gravity and the relative transverse separation of 
the cc pair, respectively. The LC wave function \l/g^(r) of the cc component of the incident 
gluon in Eqs. (PD-(PDD reads, 

n^i^ = e^i^oKr) , (11) 

where the vertex operator has the form, 

f = rrica ■e + i{l-2a) (a - ra)(e ■ V) + (n x e) ■ V , (12) 

where V = d/dr\ a is the fraction of the gluon light-cone momentum carried by the c quark; 
e is the polarization vector of the gluon; and is the c-quark mass. 

The profile function 'y'^^\s) in Eqs. (^ ^(0) related by Fourier transformation to the 



amplitude F^^^kx, {X}), of absorption of a real gluon by a nucleon, GN X, which also 



can be treated as an "elastic" (color-exchange) gluon-nucleon scattering with momentum 
transfer kx, 



lot. 



d^kn 



(13) 



where the upper index (e) shows the color polarization of the gluon, and the variables {X} 
characterize the final state X including the color of the scattered gluon. In what follows we 
assume dependence on the variables {X} implicitly. 

It is important for further consideration to relate the profile function (|T^) to the unin- 
tegrated gluon density jF(/cy,x) and to the dipole cross section crqq(r, x), 



1 d%d{X} |7^'Hs + f) -7(^)(s) 



47r 



d^k 



'T 



(14) 



where X2 = M?^/{2mj\fEG) in the nucleon rest frame. 

Let us consider the production cross sections of a cc pair in each of three states listed 
above, Eqs. (|D-(||). The cross section of a color-singlet cc pair, averaged over polarization 
and colors of the incident gluon reads, 

1 



a 



(1) 



(27r) 



da d^ndP'kT Afj^^{K.,kT 



a, 



(15) 



Using relations (|T]), ®, (pT|) and ([T^) this relation can be modified as, 



(16) 



1 



where 

I _ 2 (Mr 

Y *'^^(F, a) = ml Kl{m,r) + {a" + a^) ml Kl{m,r 

The cross sections of a color-octet cc pair production either in 8~ (Odd) or 8+ (Even 
states has the form. 



17) 



a 



(8) 

0{E) 



1 



(19) 
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where 



(8)^ ^ 



^ N f \ 



9 
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a^q{r, X2] 



(20) 
(21) 



The total cross section of a cc pair production reads, 



a{GN ccX) = a(^) + a§^ + = Y, Jdc^Jd^r a^ir, a, X2) |^^^(r, a) 



where 
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a3[r, a, X2j 



(T^(ar, X2) + cT^(ar, X2] 



(22) 



(23) 



In order to estimate the relative yield of the 1~, 8~ and 8^ states we can rely upon 
the approximation cr|^(r) oc which is rather accurate in the case of a cc pair, since its 
separation r ~ l/rric is small. Then we derive. 



,(1) . ^(8) . (8) 



(To ■■ (Ti 



^ _ 5 _ 117 

■ 2 ■ To" 



(24) 



Thus, about 20% of the produced cc pairs are in a color-singlet state, the rest are color- 
octets. One can calculate the inclusive cross section of open charm production in pp collision 
multiplying the color-octet part of the cross section Eq. (|22|) by the gluon distribution in 
the proton. 



da{pp {cc}sX) 9 



dy 



where G{xi) = xig{xi) and 



G{xi) ^ da d^ 



ag{ar, X2) + (Tgq{ar, X2) - - ag{r, X2) 



Xi 



M? 

cc 
X2 S 



(25) 



(26) 



Note that not all the color-singlet pairs end up with charmonium states, but some may 
decay to open charm channels and end up with DD. We come back to this problem in 
Sect. |3l. 
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2.2 Multiple color- exchange interactions and production of a cc 
pair in nuclear matter 

An important advantage of the LC dipole approach is the simphcity of calculations of 
nuclear effects. Since partonic dipoles are the eigenstates of interaction one can simply 
eikonalize the cross section on a nucleon target ||13[ provided that the dipole size is "frozen" 
by Lorentz time dilation. Therefore, the cross section of cc pair production off a nucleus 



has the form [21 



± 

a{GA ccX) = 2 ^ j (fh j (fr j da \^''~^{r,a)^ |l - exp 



--o-3(r,a, X2)Ta(6) 



(27) 



Apparently, this expression leads to shadowing correction which is a higher twist effect and 
vanishes as 1/wi^. Indeed, it was found in ||2l| that in the kinematic range of fixed target 
experiments at the Tevatron, Fermilab, X2 ~ 10^^, ~ 0.5, the shadowing effects are 
rather weak even for heavy nuclei. 



i?A<0.05 



(28) 



where Ra is defined in (p. 

On the other hand, a substantial shadowing effect, several times stronger than (|28D was 
found in for charmonium production, although it is also a higher twist effect. In the 
case of open charm production there are additional cancellations which grossly diminish 
shadowing. The smallness of the effect maybe considered as a justification for the parton 
model prescription to neglect this correction as a higher twist effect. However, the dipole 
cross section cr|^(r, X2) steeply rises with I/X2 especially at small r and and the shadowing 
corrections increase reaching values of about 10% at X2 = 10^^, and about 30% at X2 = 10~^. 
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3 Gluon shadowing 

The phenomenological dipole cross section which enters the exponent in Eq. (l27| ) is fitted 
to DIS data. Therefore it includes effects of gluon radiation which are in fact the source of 
rising energy (1/x) dependence of the CT^q{r, x). However, a simple eikonalization in Eq. (|2^) 
corresponds to the Bethe-Heitler approximation assuming that the whole spectrum of gluons 
is radiated in each interaction independently of other rescatterings. This is why the higher 
order terms in expansion of ( pT] ) contain powers of the dipole cross section. However, gluons 
radiated due to interaction with different bound nucleons can interfere leading to damping 



of gluon radiation similar to the Landau-Pomeranchuk p2[ effect in QED. Therefore, the 
eikonal expression Eq. (^) needs corrections which are known as gluon shadowing. 

Nuclear shadowing of gluons is treated by the parton model in the infinite momentum 
frame of the nucleus as a result of glue-glue fusion. On the other hand, in the nuclear rest 
frame the same phenomenon is expressed in terms of the Glauber like shadowing for the 



process of gluon radiation In impact parameter representation one can easily sum up all 



the multiple scattering corrections which have the simple eikonal form |13|. Besides, one can 
employ the well developed color dipole phenomenology with parameters fixed by data from 
DIS. Gluon shadowing was calculated employing the light-cone dipole approach for DIS [|17| 
and production of charmonia 0, and a substantial deviation from QCD factorization was 
found. Here we calculate gluon shadowing for cc pair production. 

3.1 Associated gluon radiation, G N — > ccGX 

First of all, one should develop a dipole approach for gluon radiation accompanying pro- 
duction of a cc pair in gluon-nucleon collision. Then nuclear effects can be easily calculated 
via simple eikonalization. 

The amplitude of the process GN ccG is illustrated in Fig. 0. According to the 



general prescription |10] the dipole cross section which enters the factorized formula for the 



process of parton a-nucleon colhsion leading to multiparton production, aN b + c + 
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Figure 2: Perturbative QCD mechanism for production of a cc pair and 
a gluon in a gluon-nucleon collision. The upper blob includes different 
attachments of the gluons as is depicted in Fig. |^. 

. . . + d X, is the cross section for the colorless multiparton ensemble \dbc. . . d). The same 
multiparton dipole cross section is responsible for nuclear shadowing. Indeed, in the case of 
the process GN ^ ccX it was the cross section as Eq. (^) which correspond to a state 
\ccG) interacting with a nucleon. 

Correspondingly, in the case of additional gluon production, G ^ ccG, it is a 4-parton, 
\ccGG), cross section cr4(r, p, ai, 0:2, as). Here r*and p are the transverse cc separation and 
the distance between the cc center of gravity and the final gluon, respectively. Correspond- 
ingly, ai = ttc, 0(2 = etc, and as = ac- 

Treating the charm quark mass as a large scale, one can neglect r <^ p, then the com- 
plicated expression for (74 becomes rather simple. One should disentangle two possibilities. 

1. The cc pair is in a color-singlet state. At r = it does not participate in the interaction 
with the nucleon target, therefore in this limit, 

c^l'^ =o^gg(«sp) • (29) 

Here ace is the cross section of interaction of a glue-glue dipole with a nucleon. 
Although we do not rely on perturbative methods of calculation of the dipole cross 
section, we will assume that the relation between the qq and GG dipole cross sections 
is given by the simple Casimir factor, 

c^GG{r) = lag{r) . (30) 
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2. The cc pair is in an octet-color state, then at r = it is indistinguishable from a gluon. 
Therefore, the 4-parton cross section becomes a 3-gluon one which has the form, 

1 



04 



o"gg(p) + o"GG(tt3P) + (yGciazp) 



(31) 



Remarkably, in the limit 0:3 ^ 1 we are interested in. 



(1) 



as— >0 



(8) 



03^0 



f^GG(p) , 



(32) 



i.e. the cross section is independent of the color state of the cc pair in this limit. 

As far as the cross section and the ccG LC wave function, ^^^;,(a)(^, p, Oc, Q^g, e})' 
known, the cross section of the reaction GaN —>■ ccGbX takes the form, 

2 Nc N^^l 



o-(G'aiV ^ ccGfo) = XI H H XI J d'^rcfpdacdac 



^ |^fj>(a)(^'P'«c,aG,e» a4(f,p,ac,aG) • 



(33) 



The analysis of the structure of the amplitude GN ccG^X is performed in the 
Appendix A in the leading order in assuming ac ^ A^/M|^ ^ 1 and r ~ mc <^ 1/ Kqcd- 
The amplitude Eq. ( |A.52|) contains in the curly brackets three terms which correspond to 
three different states of the cc pair and to the following LC wave functions of the ccG system. 

a) The cc pair is in a color-singlet asymmetric state (1~). 

1 



^S'^(a)(^P'"c,aG,e/) = 



5ab % ^~^^{r, a,) [^ic Hp + «cr) - Hp - «cr) 
b) The cc pair is in a color-octet asymmetric state (8^). 



(34) 



9=1 



<l>fc^(p+«,f)-$^»^^(p-a,f) . (35) 



c) The cc pair is in a color-octet symmetric state (S"*"). 



V3 X /a69(r,).,^'"''^(r,ae) 
9=1 

<^>fG Hp'+ "cr-) + ^Z\p- a.f) - 2 <!>S\P) 



(36) 
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Within perturbative QCD used so far and in Appendix A, the functions ^cg{p) are equal 
for different states, 1^, 8^ and 8+. 

€g\p} = ^S\P} = ^S\P} = ^ ■ V K,{tp) , (37) 

V3 TT 

where 

= + ac Ml . (38) 



However, the nonperturbative effects considered further in Sect. p.3| make these functions 
different, so we mark them in accordance with the color state of the cc. Note that $cg(p) 
is different from the LC wave function of a quark-gluon system, this is why r depends on 

Mr,. 



Relying on smallness of r ~ l/rric <^ l/r the combinations of the functions $cG in (HJ) 



- (36) can be simplified, 

$cg(p + c^ct) - $cg(p - ttcr) ^ f ■ V $cg(p) ; (39) 

^cg{p + oi,r) + $eG(p - oi,r) ^ -l^ccifi) ~ (2^^ - 1) f ■ V ^,g{p) ■ (40) 
We use this approximation in what follows. 

3.2 Reaction G A — > ccG X and gluon density in nuclei 

Precess of gluon radiation off nuclei is related to gluon shadowing. It was first suggested 



m 



to use a process j A ^ GGX, where j is a colorless current, as a probe for gluon 
distribution in the nucleus. There are more hard reactions with gluon radiation which 
can be used as a probe for gluon shadowing (see e.g. in P,|l3l)- However, one should be 



cautious relying on the process independence of gluon shadowing which follows from QCD 
factorization. It is not obvious that the charm mass scale is sufficiently high to neglect higher 
twist effects. It is especially problematic for gluon radiation which involves a semi-hard scale 
| T7[| . Indeed, it is demonstrated in that gluon shadowing in charmonium production is 



much stronger than in DIS IT^]. Therefore, gluon shadowing should be calculated separately 
for each color state of the produced cc pair. 
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Following |11,17, 24-2^ the cross section of the reaction G A ^ ccGX is presented in 
the form, 

a{GA ccGX) = A a{GN ccGX) - Aac , (41) 
where the second term Aac describing shadowing of gluon density has the form, 

Acre ~ J ^^^^ '^^'"2 d^Pi d^p2 d^b dzi dz2 dac d(ln ac) 

^ H ^ Yl *fj';'6(a)(^2,P2,ac,aG,e/)a4(f2,p2,ac,aG)GgcG(^2,P^ 



X cr4(fi. Pi, ttc, "g) '^ijl[a)(^l^ Pi' "G, e» pAip, Z2) pAip, Zi) Q{z2 - Zi) . 



(42) 



Here Gccg{^2, p2, Z2; ri, pi, zi) is the LC Green function describing evolution of the ccG sys- 
tem from initial separations fi, pi at the point Zi to final r2;P2 at the point Z2- It obeys 
the Schrodinger type equation. 



i -S- GccG{r2, p2, Z2] fi. Pi, Zi] 

OZ2 



A 



T2 



A 



P2 



X G'ecG(^2,P2,2;2;fi,pi,2;i) 



0-4(^2, P2, "c, OLg) PA{h, Z2) 



where u is the energy of the incident gluon, and the boundary condition is 



G'gcG(^2,P2,2:2; ri,pi,2:i) 



5{f2 - n) 6{p2 - Pi) 



(43) 



(44) 



The dominant contribution to integration in ac in (^2]) comes from the region of small 
ac < X^/M?^ <ti 1, therefore, according to (^) we can assume in (^2]) and (|^) that 



(T4(r,p,ac,aG) = o-gg(p) 



(45) 



In this case the Green function factorizes as 



GccG{r2, P2, Z2; fi, Pi, zi) = Gcc{r2, Z2] ri, Zi) G(cc)g{P2, Z2] Pi, ^i) 



(46) 



where Ggc describes the intrinsic life of the cc pair, while G(^cc)g controls the relative motion 
of the point-like cc pair (when its size is neglected) and the gluon. These two-body Green 
functions obey the following equations. 



ii^Gcc{r2,Z2;n,zi) 

dZ2 



A 



r2 
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+ ycc{ri,Z2) 



Gcc\f I, Z2] r 1, zi 



(47) 



i-^G(cc)G{p2,Z2]pl,Zi) 
OZ2 

with boundary conditions 



2iyaGaG 



+ Vgg{P2,Z2) 



G{cc)g{P2,Z2]Pi,Zi) 



(48) 



G'cc(^2; Z2', ri, Z\^ 

G(cc)g{P2, Z2] Pl,Zi^ 



22 = 21 



22=21 



S{f2 - fi) 

6{p2 - Pi) 



(49) 



The imaginary parts of the hght-cone potentials in ( ^Tj) and (^) describe absorption of 
a cc or GG pairs propagating through the nucleus. 



lmVcc{r2,Z2) 

lmVa,ip2,Z2) 



--aqq{r2) pA{b,Z2) ; 
-^(^gg{P2) pA{b, Z2) 



(50) 
(51) 



The real parts of the potentials take into account the interaction between the partons 
and in particular incorporate phenomenologically confinement. This interaction is very 
important for massless gluons and is considered in next section. At the same time, for a 
heavy cc both the interaction potential and absorption cross section are small and can be 
neglected. Then, the Green function Gcc(^2, Z2]ri,zi) describes the free propagation of a cc 
pair, and the solution of Eq. (^) has the analytical form |27[| , 



exp 



i'acac[,r2 - rx, 
2i{z2 - zi) 



(52) 



2m{z2 - zi) 

In the high-energy limit, z/ — oo, all fluctuations of the size of the cc pair are "frozen" by 
Lorentz time dilation for the time of propagation through the nucleus, therefore. 



Gcci^2, Z2] fl, Z\^ 



b{f2 - fl) . 



(53) 



In this limit also the Green function G(^cc)g{P2, Z2', pi, zi) which describes relative motion of 
the point-like color-octet cc and the gluon takes the simple form. 



G(cc)g{P2, Z2] Pi, Zi^ 



S{P2 - Pi) exp 
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o-gg(P2) / dzpA{b,z) 



«i 



(54) 



Now we can switch back to the gluon shadowing correction Aac in Eq. (^1]) related 
to coherence effects in gluon radiation by a cc pair propagating through the nucleus. The 



result may depend on the state in which the cc pair is left after the gluon is radiated. We 
classified above those states as 8^ and 8^. In what follows we mark these states by 
index = 1^, 8^ or 8^. In the limit u —* oo the corresponding gluon shadowing corrections 
to the cross section of the process G A ^ cc GX in Eq. ( |iT| ) read, 

AaP = 5^^) aiGN ^ ccGX) , (55) 

where 

1 /" -* 

5'^^^ = d%d'^p2d^pidz2dziV^^^G{p2,aG/ac)aGG{p2)G(^cc)G{P2,Z2\pi,zi^ 

X V$i§(pi, aG/ac)PA(&, ^2) Pa(&, 2:1) 9(^2 -2:1) . (56) 

Thus, the entire dependence on the state "fc" in which the cc pair is produced, comes via 
the wave functions which varies with k only if the nonperturbative interaction between 
partons matters and is sensitive to k. We discuss the influence of this nonperturbative 
effects in more detail below. 

At finite energies v the size of the cc system can fluctuate during propagation through 
the nucleus. In order to incorporate this effect one should introduce under the integral in 
Eq. (^) an extra factor 

- ^ ■ (") 

where 

^^'^ =E / rfVidV2dae*^'^'(rl,ac)a-c(rl,Z2;ri,Zi)^^'^(rl,aJ(ri-f2) /('=)(«,) , (58) 

= Y^[ d\da, \^~^^{r,a,)t f^'\a,) . (59) 

Here the fc-dependent factor f^'^'^ reads, 

1 for the states 1~, 8~ 

f^'\ac) = (60) 
[ {2ac - 1)^ for the state 8+ . 

Apparently, J*^'^-* ^ 1 at ^ 00. 
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Using the analytical expressions Eq. (52) for Gcc and Eq. (|rT|) for \E"^^ we arrive at 



^(fc) ^ ll-^daJ^^Xa,) {E2{w) + 2a,a,[2E^{w) - 2E,{w) - E2(w)]} 
where En{w) are the integral exponential functions, 

oo 

E^{w) = J-^e-\ (62) 
1 

iml{z2 - zi) 

w = 



^vacCXc 

A remarkable observation is that for finite formation times for the ccG system the gluon 
shadowing factor S'*-'^-' varies with k even in perturbative case when the partons propagate 
as free particles and the function ^^^^ is independent of k. In the limit of ^ oo the 
universality of perturbative gluon shadowing is restored. 

3.3 Self-interacting ccG 

One can treat partons as free only if their transverse momenta are sufficiently large, other- 



wise the nonperturbative interaction between partons may generate power corrections [0. 
Apparently, the softer the process is, the more important are these corrections. In particu- 
lar, diffraction and nuclear shadowing are very sensitive to these effects. Indeed, the cross 
section of diffractive dissociation to large masses (so called triple-Pomeron contribution) is 
proportional to the fourth power of the size of the partonic fluctuation. Therefore, the at- 
tractive nonperturbative interaction between the partons squeezes the fluctuation and can 
substantially reduce the diffractive cross section. Smallness of the transverse separation 
in the quark-gluon fluctuation is the only known explanation for the observed suppression 
of the diffractive cross section, which is also known as the problem of smallness of the 
triple-Pomeron coupling. While no data sensitive to gluon shadowing are available yet, a 
vast amount of high accuracy diffraction data can be used to flx the parameters of the 
nonperturbative interaction. 
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To solve the light-cone Schrodinger equation for the Green function analytically we use 
the oscillator form of the light-cone potential of interaction between the gluon (with small 
1) and quark, 



(64) 



2uaGaG 

With such a form of the potential one can get an analytical solution of Eq. (|48|) assuming also 
that o"gg('") ~ Cgg{s) '^^j where Cgg{s) = daGGi.^^ s)/drf.^Q. The result has a form |1T7| , 

A 



Ggg{P2, Z2] Pi, zi] 



X exp 



A 
'2" 



27rsinh(^] A^) 



(Pi + P2)coth(fiAz) 



sinh(fi A^) 



(65) 



where 



A 
Az 



bo^ - i acc^G ^ Cgg Pa 
iA 



Z2- Zi . 



(66) 



With this Green function one also gets the nonperturbative wave function for the qG 
Fock component of the quark , 



*qG(p) 



2 i faj ef ■ p 



TT 



P' 



(67) 



Fitting the only free parameter Bq to data for large mass single diffraction pp — > pX which 
corresponds to diffractive gluon radiation, one finds a rather strong interaction for gluons, 
60 = 0.65 GeV [|l^. Thus, the mean size of the qluon cloud of a quark turns out to be 
surprisingly small, tq = 



(P^) — 0.3 fm. Such a picture of the proton which consists of 
valence quarks surrounded by small size gluon clouds correctly reproduces the observed 
energy dependence for total hadronic cross sections [Q. Besides, it goes along with the 
results of nonperturbative approaches. The same size emerges from lattice calculations for 
the glue-glue correlation radius |2^, from the instanton liquid model |^ and from the QCD 
sum rule analysis of the gluonic form factor of the proton |3l[ . 
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These results are relevant to and were used in ^Tj for calculation of gluon shadowing 
in DIS where a colorless virtual photon fluctuates into the color-octet-octet system, 7* —>■ 
{qq)s G. The nonperturbative interaction between the partons within a color-octet system 
ccG which is under consideration, may be different. Indeed, if the small size, r ~ l/rric, cc 
pair is a color singlet, the interaction between the cc and the gluon should be very weak. In 
this case one should use the perturbative expression Eq. (^) for the $^1^ ^ which corresponds 
to a large size ~ 1/Aqcd fluctuation and strong gluon shadowing. Indeed, it explains the 
strong nuclear suppression of J/\E' production observed at small X2 0. 

If, however, the cc pair is a color octet, 8^ or 8^, and its size is neglected, then it is 
equivalent to a gluon and interacts in the same way. Thus, we came to the problem of 
interaction between two gluons in one of the two possible color octet states which have 
different symmetries relative permutation of the gluon's color indexes [compare with (^) - 

dH)], 



^a)GG = V? ^abg\Gb) \Gg) ; (68) 

b,g=l 



\8a)^G = 4? E \G,) \G,) . (69) 

V-3 b,g=l 

The states in the left-hand-side of these equations are the two-gluon Fock components of a 
gluon, which are symmetric (S), or asymmetric {A) relative permutation of the indexes b 
and g. They correspond to 8^ and 8+ states respectively. One of the gluon is marked with a 
tilde in order to emphasize that this is a color-octet point-like cc pair, rather than a gluon. 
Correspondingly, the color-singlet state of two gluons which occurs in DIS has the form, 

\1)gg = ^ E Sb,\G,)\Gg) . (70) 



',3=1 

The strength and sign (attractive or repulsive) of the nonperturbative interactions be- 
tween the gluons depends on their configuration, Eqs. (^) or ([70|). to. The potential is 
known from data analysis only for the color singlet case Eq. (^), and it is impossible to 
predict the interaction potential for other states having no knowledge of the interaction dy- 
namics. To establish relations between the potentials corresponding to the states Eqs. (|68| ) - 
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(|70|) we rely on the relations between "Coulomb" perturbative potentials. The corresponding 
potential has the form, 

(71) 



Vbg,b'g' {r ) fbeb' fgeg' 



e=l 



This potential is related by Fourier transformation to the amplitude of G — G scattering via 
gluon exchange in the cross channel, as is illustrated in Fig. ^ 

b b' 



G 



CC(8) 



g 



Figure 3: Born graph for scattering of a gluon with color indexes b, b' 
on a cc pair in color-octet state with indexes g, g' . 



Calculating the matrix elements with the operator Eq. (^) between the states Eqs. 



(|70|) we arrive at. 



s{UVma,)s = -^^^aa'-, (72) 
A{Sa\V{r)\8,>)A = -^^Saa'-, (73) 

2 r 

{l\V{r)\l) = -3^; (74) 

r 

s{8a\V{r)\8a')A = s{8a\V{r)\l)=A{8a\V{r)\l) = (75) 

Here the subscripts 5* and A correspond to the symmetric and asymmetric states Eqs. (|6^) 
and (|69|) respectively. 

Thus, the states Eqs. (|68D - (|70|) are the eigenstates of the operator Eq. (ffll). All 
the matrix elements have negative signs, what means that also in color-octet states glue- 
glue interaction is attractive. We assume that the relation between the nonperturbative 
potentials for the glue-glue system in different states is the same as in the perturbative case. 
Then, we arrive to the following relation between the potentials corresponding to the color 
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octet and singlet states Eqs. (|68 



ReVs, : ReVs, ^ ^^^i = ^ ^ ^ ^ 1 (76) 
Comparing with the known value of the parameter Bq = 0.65 GeV in the potential Eq. ( |64D for 



bo 



the color-singlet \ccG) state [jT^ we get the following values corresponding to fluctuations 
of a gluon containing a color-octet cc, symmetric and asymmetric, and one containing a 
color-singlet cc, Eq. ([70D, 

0.55 GeV for the symmetric octet — octet state Eq. (68) 

0.50 GeV for the asymmetric octet — octet state Eq. ( p^D (77) 

0.20 GeV for the singlet — octet state . 

Thus, the strength of the interaction between the cc and gluon varies from channel to 
channel. Correspondingly, the mean transverse separation for the effective glue-glue dipole 
propagating through the nucleus changes as well affecting the strength of gluon shadowing. 

3.4 Process-dependent gluon shadowing 

We calculated the gluon suppression factor in nuclei as function of X2 according to Eq. (^) 



as, 



using Eqs. (|42|) - (|6ll) and (|65D for the different values of bo Eq. ([77|) . The results for gold are 
shown by dashed curves in Fig. ^ The curves for the symmetric and antisymmetric states, 
Eqs. (1^) and (|^) are indistinguishable, since corresponding values of bo in ([77|) are close. 



They are represented by a single (upper) curve which demonstrates a stronger shadowing 
effect than was found in |T^ for gluon shadowing in DIS, since the value of 6o is smaller. 
Gluon shadowing corresponding to production of a colorless cc pair shown by the bottom 
curve is the strongest one, as it was already found in for charmonium production. Also 
the onset of shadowing happens differently, the smaller Bq is, the earlier (at larger X2) the 
onset of shadowing occurs. This is because the mean effective mass of a ccG fluctuation 
increases with 60 • 
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Figure 4: Ratio of gluon densities Rc{Au/p) = GAuix2)/l95 Gp{x2) for 
color octet-octet and singlet-octet states (cc) — G (dashed curves). The 
averaged gluon shadowing is depicted by solid curve. 

3.5 DD production from a color-singlet cc 

Apparently, not every cc pair produced in a color-singlet state ends up by formation of 
a charmonium. Some of them, in particular those which are very heavy, can hadronize 
producing a DD. Since the process of color-singlet cc production is associated with a 
strongest effect of gluon shadowing (see Fig. ^) its contribution to open charm can affect 
the expected nuclear shadowing. 

It is difficult to calculate reliably the fraction of colorless cc pairs decaying into open 
charm, since the hadronization dynamics is quite complicated. One can rely on a simple 
recipe: the color-singlet pairs with effective mass below or above the DD threshold end up 
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with either hidden or open charm respectively. Then, the fraction 6 which goes to open 
charm is, 

oo 

r ^ /I f 2 da 



s 



(79) 



The effective mass of a color-singlet pairs depends on relative transverse momentum 
and sharing of the longitudinal momentum a, 



Mi 



ml + kl. 



a a 



10) 



Note that we must consider only the cc pairs which can be produced in two-gluon fusion. 
Correspondingly, the mass distribution can be deduced from the differential cross section 
which according to [1^,3^ is given by the double Fourier transform of the bilinear combi- 
nation of the dipole amplitudes, 

X ml Ko{mcri) Ko{mcr2) + (a^ + a^) Vi-ft'o("^c'"i) ■ V2-ft'o("^c'"2) 

X [agq{afi + af2) + crqq{ar2 + afi) - aqq[a{fi - f2)] - agg^^ (81) 

Integration of this expression over fc^ and a recovers the cross section Eq. ([16|) for production 
of color-singlet G N ^ (cc)i X. The mean cc separation is small, hence one can employ the 



dipole approximation, cr. 



C r^. Then the last factor in curly brackets of (|8ll) becomes 



as simple as 2 Crl ■ r2, and the cross section takes the form 

da a, C 



d^kx da 647r 
which leads to the mass distribution, 

— 

da a. C 



4 k"^ ml a a 



+ 



{k^ + miy (kl + ml) 



dW^ 647r 



da 



where 



1/2 



a. 



Ami 



Am: 



+ 



a^ + a^ 



M^aa M^d^a^ a a 



(83) 



4m^ 
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M) 



Eventually, the differential cross section can be represented as 
da a, C 



5) 



With this mass distribution the fraction of the cross section above the DD threshold calcu- 
lated at mc = 1.5 GeV turns out to be quite large, 

5 = 0.86 . (86) 

We conclude that only a small fraction of colorless cc pairs fragments into charmonia. 

Apparently, the estimate Eq. (|86|) is quite rough and gives only the order of magnitude 
for the value in question. One can also try to evaluate this number using available data for 
production rate for charmonia (\E', Vc) relative to open charm in high energy pp collisions. 
We accept that J/"^ yield is about 2.5% of open charm |3^, and that nearly 30% of J/\E's 
originate from decays of xi and X2 01 ■ Further, according to the Landau- Yang theorem 



production of Xi is forbidden for collinear approximation in the parton model. However, 



corrections due to nonzero longitudinal polarization of the fusing gluons may be large [pi 



We rely on experimental value 0.7 [0,^ for the ratio of Xi and X2 production rates. Since 



the branchings for decay of Xi and X2 to J/\E' are 27% and 13.5% respectively, we find that 
production rates of X2 is approximately 1.5% of open charm. The yield of the S-wave states. 



rjc, can be estimated using the ratio rjc to X2 of production rates which according to [37 
depends on the wave functions of the charmonia at the origin. Using the wave functions 
from [^H we found about three times more rj^s than X2S. Summing up the channels which 



can originate from glue-glue fusion, xs and rjc, we arrive at about 7% of open charm, while 
20% of all cc pairs are produced in color-singlet states. Then, 

5 = 0.7 . (87) 

Thus, both very different ways to evaluate 6, show that the main fraction of colorless cc 
pairs produced in NN collisions hadronizes to channels containing open charm. They also 
provide the scale of theoretical uncertainty which is not too bad. For further estimates we 
use the value 6 = 0.75. 
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We mix the octet and singlet contributions to gluon shadowing with the weights found 
above, Rq = (0.8 + 0.14 i?^)/0.94. The result is shown in Fig. § by solid curve. This 
effect is about twice as strong as gluon shadowing calculated in |]T^ for DIS demonstrating 
a substantial deviation from QCD factorization. 

4 Shadowing effects for charm production off nuclei 

To observe the shadowing effects in open charm production one must access the kinematic 
region of sufficiently small X2 ^0.1. With fixed targets it can be achieved at highest energies 
at Fermilab and in the experiment HERA-B at DESY. We apply the results of previous 
section for gluon shadowing to cc pair production in proton-nucleus collisions. We assume 



that the cc is produced with Feynman xp corresponding to X2 = {—xp + yx^p + 4M£,/s)/2, 
where we fix Mgc = 4 GeV. The contribution of gluon shadowing to nuclear effects in 
proton-tungsten collision at piab = 900 GeV is depicted by the dashed curve in Fig. |^. 

The higher twist shadowing correction corresponding to the eikonalized dipole cross 
section in (^) is also a sizeable effect and should be added. It is diminished, however, 
due to the strong gluon shadowing which also reduces the amount of gluons available for 
multiple interactions compared to the eikonal approximation (^). We take this reduction 
into account multiplying in (|27|) by Rg{x2, Mcc)- The summed shadowing suppression of 
cc production is depicted in Fig. || by the solid curve. 

Besides shadowing, other nuclear effect are possible. The EMC effect, suppression of 
the nuclear structure function F^i^XjQ"^) at large x, as well as the enhancement at x ~ 0.1 
should also lead to similar modifications in the gluon distribution function G^{x, Q^). These 
affects are different from shadowing which is a result of coherence. A plausible explanation 



relates them with medium effects, like swelling of bound nucleons S^. To demonstrate a 
possible size of the medium effects on gluon distribution we parametrize and apply the effect 
of gluon enhancement and suppression at large x suggested in |0. Although it is based on 
ad hoc gluon shadowing and underestimated shadowing for valence quarks (see in [|lll), it 
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Figure 5: Nuclear effects for open charm production in pw collisions at 
900 GeV in the laboratory frame. The contribution of gluon shadowing 
is shown by dashed curve. The solid curve represents the full shadowing 
effect including shadowing of charmed quarks in the nucleus. Possible 
medium effects including antishadowing and EMC-suppression for gluons 
^ are also added and the result is represented by the dotted curve. 



demonstrates the scale of possible effects missed in our analysis. 

There are still other effects missed in our calculations. At this energy the effect of energy 
loss due to initial state interactions is important enhancing nuclear suppression at large 
xp (compare with 0). Another correction is related to the observation that detection of a 
charm hadron at large 1x^1 does not insure that it originates from a charm quark produced 
perturbatively with the same xp. Lacking gluons with xi^2 1 one can produce a fast 
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charm hadron via a fast projectile (usually valence) quark which picks up a charm quark 
created at smaller \xf\ (see also Sect. This is actually the mechanism responsible for the 
observed D/D asymmetry. It provides a rapidity shift between the parent charm quark and 
the detected hadron. Therefore, it may reduce shadowing effects at largest \xf\- We leave 
this problem open for further study. 

To predict shadowing effect in heavy ion collisions we employ QCD factorization which 
we apply only for a given impact parameter. For minimal bias events 

RAB{y) = Ra{xi) Rb{x2) , (88) 

where y = ln(xi/a;2)/2 is the rapidity of the cc pair. Our predictions for RHIC {^/s = 
200 GeV) and LHC {^/s = 5500 GeV) are depicted in Fig. || separately for net gluon shad- 
owing (dashed curves) and full effect including quark shadowing (solid curves). Although 
shadowing of charmed quarks is a higher twist effect, its contribution is about 10% at RHIC 
and rises with energy. 

One might be surprised by the substantial magnitude of shadowing expected at the 
energy of RHIC. Indeed, the value of xi^2 ~ 0.02 at mid-rapidity is rather large, and no 



gluon shadowing would be expected for DIS |17]. However, the process of charm production 



demonstrates a precocious onset of gluon shadowing as was discussed above. Besides, the 
nuclear suppression is squared in AA collisions. 

Unintegrated shadowing Eq. (^) depends on impact parameter b. The strength of 
shadowing, 1 — RA{x,b), turns out to be nearly proportional to nuclear thickness TA{b) 
11,2^]. Nuclear shadowing for heavy ion collision at impact parameter b reads, 

i?^^(6) = -\. I dHR\s)TA{s)R^{b-s)TB{b-s) . (89) 

This expression is normalized to one in absence of shadowing. We calculated shadowing for 
most central collisions at 6 = 0. The results for the energies of RHIC and LHC are depicted 
by dashed curves in Fig. |^ in comparison with shadowing for minimal bias collisions shown 
by solid curves. Calculations include both the gluon and quark shadowing effects. 
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Figure 6: Nuclear shadowing for open charm production in minimal bias 
gold-gold collision. Dotted curves correspond to net effect of gluon shad- 
owing, while solid curves include both effects of gluon shadowing and the 
higher twist correction related to the nonzero separation of the cc. The 
top (RHfC) and bottom (LHC) curves correspond to ^/s — 200 GeV and 
5500 GeV respectively. 



Surprisingly, we hardly observe any difference between the expected shadowing effects for 
minimal bias and central collisions. This contradicts a simple intuition which relates central 
collisions to maximal nuclear thickness. To understand the source of such a similarity 
of the shadowing effects let us consider a simple model for shadowing whose strength is 
proportional to the full path length L{b) in the nucleus (see the comment above), where 
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Figure 7: Comparison of minimal bias and central (b — 0) collisions rep- 
resented by solid and dashed curves respectively. The top (RHIC) and 
bottom (LHC) curves are calculated at — 200 GeV and 5500 GeV 
respectively. Both effects of gluon shadowing and the higher twist cor- 
rection are included. 



L — 2^ R\ — for the case of homogeneous nuclear density reads, 



Then, averaged over h shadowing reads. 



Ra{x) = 1 - A(x) 



For minimal bias AA collisions. 



R'i^{y)= l-A{x,) l-A{x,) 
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For central AA collision at 6 = 
1 



TDcentral 



(y) 



3 Ra 



A{Ta) 

With a constant nuclear density, TA(h) = 2poL{b), we find 



. 2 ^ , , L{s) 



(93) 



Tycentral 



^AA 



16 
15 



[A{xi)+A{x2] 
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(94) 



Comparing with shadowing for minimal bias events, Eq. we see that the coefficients 
16/15 and 32/27 in ( P^ ) are not very different from one. This is why R^^{y) and 
depicted in Fig. |^ are so similar. 



Thus, if data, like recent results from PHENIX lETl, demonstrate no difference in amount 



of produced charm between central and minimal bias collisions of heavy ions, it should not be 
interpreted as an indication to weak nuclear effects. Indeed, Fig. ^ demonstrates substantial 
nuclear shadowing effects at RHIC and especially at LHC, while the difference between 
minimal bias and central collisions is tiny. To detect a signal of shadowing one should 
compare amount of produced charm in central or minimal bias events with very peripheral, 
or better with pp collisions. This is planned to be done at PHENIX HTI . 



5 Final state absorption of heavy flavored hadrons 

One may expect no nuclear effects in the limit of short coherence length when a heavy QQ 
pair is produced momentarily inside the nucleus and then propagates through the nucleus. 
No shadowing is possible in this case and a question arises, if there is any nuclear suppression 
due to final state interaction? On the contrary to a conventional expectation, the answer is 
yes. 

Light hadrons are known to attenuate propagating through a nuclear matter. Although 
high energy quarks cannot be absorbed or stopped via soft interactions, any inelastic colli- 
sion, like M N M X leads to softening of the momentum spectrum of the meson. This 
is known from data and can be interpreted as a color-exchange collision which leads to 
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independent hadronization of the projectile valence q and q which carry parts of the total 
initial meson momentum. The newly produced meson can carry only a fraction of the q or q 
momenta, in average about a half of the initial meson momentum. Therefore, if one detects 
a meson with large xp any inelastic interaction of the produced meson on its way out of 
the nucleus shifts its momentum down to smaller xp what looks like absorption. The same 
obviously is valid for light baryons. Thus, nuclear attenuation of light hadrons can be and 
has been widely used as a source of information about the hadron-nucleon inelastic cross 
sections. Such information is especially precious and unique for unstable hadrons. 

At first glance, one may expect a different situation for heavy flavored hadrons. If a 
hadron contains only one heavy quark (open flavor), even simple kinematic consideration 
shows that the heavy quark carries the major fraction of the hadron momentum. Therefore, 
after the hadron breaks up in an inelastic collision, the heavy quark picks up an antiquark 
from vacuum and the recovered heavy flavored baryon has nearly the same momentum as its 
predecessor. Thus, one might think that hadrons with open heavy flavor propagate through 
nuclear matter practically without attenuation even at large xp (except the very endpoint 
values xp > i — Tnq/mq). 

However, a deeper insight shows that such a consideration is oversimplified. Indeed, a 
heavy quark pair QQ is produced mainly in central rapidity region ai xp <^ 1. In order to 
become a constituent of an energetic heavy hadron, the Q or Q has to be picked up by the 
energetic valence quarks of the beam hadron. Therefore, the typical configuration in which 
the hadron with open heavy flavor is produced, is very different from one discussed above. 
This is not the hadron yet, but just a colorless light-heavy quark system which needs time 
(formation length) to develop the wave function of the hadron, 

h ~ 77^^ . (95) 
^ 2ujmH 

where Eh, mn are the hadron energy and mass, and u; ~ 300 MeV is the oscillator fre- 
quency. Thus, at high energies. Eh > 10 GeV (for charm) this produced colorless quark 
system propagates through the nucleus in such an unusual configuration and forms the 
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hadronic wave function far away from the nucleus. At the same time, the energy should not 
be too high to guarantee that the coherence time tc = 2Eqq/Mqq <^ Ra- 

What happens if such a quark configuration, in which the heavy quark carries a small 
fraction of the total momentum, interacts inelastically in the nuclear medium? The answer 
is opposite to our previous expectation. The new heavy flavored hadron will be produced via 
hadronization of the slow heavy quark, therefore will be removed by the inelastic interaction 
from the high xp region. We conclude that produced heavy flavored hadrons are effectively 
absorbed the same way as light hadrons. This absorption leads to a suppression factor. 



where cr|; is the cross section of inelastic interaction of the pre-formed heavy flavored 
hadron H with a nucleon. This suppression factor can be applied only at large xp- At 
small xp <^ 1 this production mechanism is replaced by an independent fragmentation 
of the created heavy quarks into the hadron H. Such a hadron should be produced in the 
conventional configuration when the heavy quark carries the main fraction of the momentum. 
Therefore, we expect no nuclear suppression at small xp as far as shadowing is absent. There 
might be even an enhancement due to feeding from the large xp events, however this effect 
should be very small because the xp distribution of H steeply falls down towards xp = 1. 

Note that measurement of the suppression factor (p6|) provides an access to precious 
information about the interaction cross section of heavy flavored hadrons. The best energy 
range for such study would be a few tens of GeV (for charm). At the low end of this energy 
interval. Eh ~ 10 GeV one can additionally study the variation of the formation length with 
the energy of the hadron. No absorption is expected at ^ 0, while absorption increase 
with energy and saturates at ^ Ra- 

A very interesting study of interaction of the formed H states with a nucleons can be done 
using an antiproton beam with a high momentum resolution. In the reaction pp H H 
both hadrons are produced with the maximal momentum xp = 1. At Ep < 10 GeV the 
wave function of H is formed shortly and then any inelastic interaction of H leads to the 




(96) 
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suppression factor Eq. (|96D P|. Thus, in this reaction one is uniquely able to measure the 
genuine HN {H = D, Be) inelastic cross section. 



6 Conclusions 

Production of heavy flavored hadrons off nuclei is subject to nuclear shadowing. QCD 
factorization predicts it to be related to gluon shadowing, while the higher twist correction 
suppressed by the heavy quark mass squared should be neglected. However, gluon shadowing 
is still unknown from data and nuclear effects for heavy flavor production could not be 
predicted so far. 

In this paper we extend the light-cone dipole phenomenology to the case of open charm 
production. This approach has been previously developed and successfully applied to char- 
monium production 0, Drell-Yan process [p!0HT2|,p^, photoproduction of vector mesons 
26|,|4^ and deep- inelastic scattering |^^. The advantage of this phenomenology is possibil- 



ity to use the universal dipole cross section fitted to the vast amount of DIS data [|^. This 
approach allows not only predict gluon shadowing including its dependence on impact pa- 
rameter, but also calculate the higher twist correction related to shadowing of heavy quarks. 
In every case when predictions of this approach can be checked with available data, a good 
agreement is achieved. 

Strong nonperturbative effects modifying the light-cone wave function of Fock states 



containing gluons were found in [T^ . These effects substantially suppress the cross section of 
diffractive gluon radiation and gluon shadowing in nuclei. The interaction between partons 
propagating along the light-cone naturally depends on the color state of the partons. Thus, 
we predict a process dependence for gluon shadowing which is a manifestation of deviation 
from QCD factorization. In particular, we expect about twice as strong gluon shadowing 
for cc pair production off nuclei as for DIS, which is, however, weaker than for production 



■^In addition, energy dependence of the reactions pp D D and pp —^ Be Be would provide an important 
information about the intercepts of Regge trajectories associated with Be and D states, respectively. 
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of charmonia. The standard parton model has no tool to access this strong deviation from 
QCD factorization. Predictions for open charm production off nuclei are based on the 



ad hoc gluon shadowing of [0 . However, even if DIS data on nuclei were sufficiently precise 
to find gluon shadowing, one should not apply the result to open charm production which 
is subject to much stronger shadowing. 

We predict substantial shadowing effects for gluons and charmed quarks in heavy nuclei 
to be tested by future measurements at HERA-B, RHIC and LHC. In particular, we studied 
centrality dependence of these effects and found almost no difference between central and 
minimal bias collisions of heavy ions. Such a similarity indeed was observed in the PHENIX 
experiment at RHIC recently. However, it should not be interpreted as weakness of the 
shadowing effect, on the contrary, we expect shadowing to be rather strong. 

We also considered the limit of short coherence length which takes place at medium 
energies. Although no shadowing is possible in this regime, we expect strong absorption 
effects due to final state interaction. This is a consequence of an unusual configuration in 
which the heavy fiavored hadron is originally produced. 
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Appendix A Dipole representation for ccG production 

The amplitude of the process 

Ga + N -^cc+Gb + X , (A.l) 

where Ga^b are gluons in color states a and b, is described in Born approximation by the set 
of 15 Feynman graphs depicted in Fig. 

The amplitude of ccG production corresponding to graphs 1-15 has the following struc- 
ture, 

15 



1=1 

where 



^^"^i = {kl + \h D, ^ ^^'"^'^^ FcLxikT. {X}) f , f . (A.3) 



' d=i 

Here A is the effective gluon mass aimed to incorporate confinement, its value we discuss 
later. The amplitude of gluon-absorption by a nucleon, FQ^^^xi^T, {X}), determines the 
unintegrated gluon density as it is introduced in ([T^), 



/ d{X}j2\Fifl^AkT,m)f =47rJ^{e^,x) . (A.4) 
d=i 



Here 



. = ; (A.5) 

ai Ci2 tta 

where /ci, k^-, and ai, a2, as are the transverse momenta and fractions of the initial 
light-cone momentum of the projectile gluon carried by the produced c, c and G (see Fig. ||), 
respectively, and 

kT = ki + k2 + h ■ (A.7) 

The 3x3 matrixes Tl^b^{ij) in ( |A.3| ) act in the color space of the cc quarks, and the 
indexes i, j corresponds to the c and c respectively. 

abd ~ '^a '''d Tb 
38 
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rp(2) 



7^(3) 
^abd 



-'-abd 
-'-abd 



"^abd ~ ^ febd^aTe '■> 

e=l 

(8) ^'"^ 

e=l 
Af2-1 

e=l 
e=l 

(11) 

-^abd ~ ^ X/ fabeTeTd ] 

e=l 

JV2-1 

^abd ~ ^ X/ fabeTdTe ] 

e=l 

iV|-l 

-^abd ~ ^ X^ /"^e /'S'^fl ^fl ' 

e,3=l 

-^abd ~ ^ X] -^ebp "^s j 

e,g=l 
Af2-1 

-^abd ^ ^ X/ •^e''<^ •^o'eg • 
e,S=l 



(A. 



Here = ra/2 are the Gell-Mann matrixes. 

Note that the matrixes T^'j^^ are not independent, but connected by hnear relations (we 



skip the indexes abd), 



7^(5) _ 2^(1) _^ 2^(9) ^ 

7^(4) _ 7^(2) _^ 7^(8) ^ Q 
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7-{6) _ 2^(2) _^ j^iW) ^ Q . 
2.(13) _ _^ j.{13) ^ Q . 

y(13) _^ J.{14) _^ rjn{15) ^ g . 
2.(15) _ rp(7) rp(8) ^ g . 

y(14) _ j.(10) _^ 2.(9) ^ g . 

(A.9) 



The c-quark spinors in ( [A.3|) are defined in ([TTD; {X} is the set of variables describing 



the state X: the 15 vertex functions f / read 



fi = Ui{ki,ai)Vi{k23,a2,a3) ; 

T2 = Viihs, ai, as) U2ik2, a2) ; 

fa = -aiUi{ki,ai)Vi{k23 ~ a3kT,a2,a3) ; 

= -a2V2{ki3 - a3kT,(yi,a3)U2{k2,a2) ; 

fs = -a2a3f^i(^i - ^T,tti) V^i(A;23,a2,a3) ; 

fg = -aia3V2{kn,ai,a3)U2{k2 - kT,a2) ; 

fr = -aiUi{ki,ai)Vi{k23 + a2kT, 02,03) ; 

fs = -^2 V"2(A;i3 + ai^T, 01,03) t^2(^2,a2) ; 

Tg = -0203^1(^1 - oifcT,ai) V"i(/c23, 02,03) ; 

fio = -0103^2(^13,01,03) f^2(/;;2 - a2/i;T,02) ; 

Til = a3f/o(A;i2 + Oi/i;T,Oi,a2)K)(^3) ; 

fi2 = -03f/o(A;i2 - 02A;t, 01,^2) V^o(^3) ; 

fi3 = O3f^o(^i2,oi,a2) Vo(/i;3) ; 

fi4 = Oia2f/o(fci2,Oi,a2) ^0(^3) ; 

fi5 = aia2f/o(fci2,Oi,a2) ^"0(^:3 - ^t) • (A. 10) 
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Here 

^13 = "3^1 - "1^3 ; 

hs = "3^2 - "2^3 ; 

tti + 02 + ^3 = 1 • (A. 11) 

The matrixes ?7o,i,2 and Vo,i,2 are defined as follows, 

Uo{ki2,ai,a2) = (ai + 02)711^ a ■ e+ (^2 - ai) (a ■ n)(ei„ ■ ^12) + « (ej„ x r?) ■ fci2 ; 
Ui{ki,ai) = ruca ■ e + {1 - 2ai) {a ■ n){ein ■ ki) + i{ein y. n) ■ ki ; 
U2{k2,a2) = ruca ■ e + {1 - 2a2) {ff ■ n){ein ■ k2) - i{ein y. ft) ■ k2 ; (A. 12) 

Voih) = efk^; 

Vi(fc23, «2, "3) = (2^2 + as) ^23 ■ e/ + ^m^ag X e/) ■ - zas (/c23 >< e/) ■ 5 ; 
^2(^13, "1, "3) = (2a;i + 0:3) ■ Cf - imcal{n X Cf) ■ a + ia-s {kis x ej) ■ a , 

(A.13) 

where and e} are the polarization vectors of the initial and radiated gluons respectively. 
The functions Di in the denominator of ( |A.3D read, 



Di = Ao(A;i,ai) A2(A;23,a2,a3) ; 

D2 = Ao(A;2,a2) A2(A^i3,ai,a3) ; 

-D3 = Ao(/ci,ai) Ai(A;i,fc23 -a3fcT,ai,a2,a3) ; 

D4 = Ao{k2,a2) Ai{k2,kis - a3kT,a2,ai,a3) ; 

D5 = Ai{ki - kT,k23,ai, 02,03) A2{k23, 02,03) ; 

Dq = Ai(A;2 - fcT,fci3,«2,a;i, "3)^2(^13, ai,a3) ; 

D7 = Ao{ki,Oi) Ai{ki,k23 + Oi2kT, 01,02,03) ; 

Dg = Ao(A;2,a2) Ai(A;2,/ci3 + tti^T, 02,01,03) ; 

Dg = A2{k23,a2,03) Aiiki- oikT,k23, Oil, 02,03) ; 

Dio = A2(/i;i3, oi, 03) Ai(A;2 - a2/;;T, /i;i3, 02,01,03) ; 
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Du = A3(A;3,ai,a3) A4(A;3,^i2 + ai^r,ai,a2,a3) ; 

Du = As{k3, ai, as) A4{ks,h2 - a2kT,ai, 02,03) ; 

Dis = A3(A;3, ai, as) A5(A;i2, 01,02,03) ; 

-Dm = A5(fci2,ai,a2,a3) ^4(^31 + ^32, A;i2,ai,a2,a3) 

-D15 = A5(A;i2,ai,a2,a3) A4(A;3 - A;T,/;:i2,ai,a2,a3) , 



where 



Ao(^i,ai) 
Ai(fci, A;23,ai,a2,a3) 
A2(/i;i3,ai,a3) 
A3(fc3, 01,03) 
A4(A;3, A;i2,ai,a2,Q!3) 
A5(/ci2,ai,a2,a3) 



ml + kl — aidi ; 

aias{a3 ml + a\0i2 A^) + Q;ifc23 + 02^2 ; 

^3 + (X\{pL\ + ^3) + A;^3 ; 

/cg + [1 - az{a\ + ai)] A^ ; 

-I 2 I \2\ I o^io^a ,2 I , 2 



"3 



"3 



^3 — (X\(X2 y? + A;^2 • 



Functions Aq - A5 are not independent, but satisfy the relation 



Ao(/i;i,ai) A2(/i;23,«2,a3) = «i 
+ a2a3 

A3(A;3, ai, ^3) A^ikyi, ai, 02, "3) 



A2(/C23, "2, as) Ai(/Ci, ^23, "l, "2, C^s) 

1 a\a2 



Ao(A;i, ai) Ai(A;i, A;23, «i, «2, "3) 
1 



as 



X 



A4(/i;s, ^12, «!, "2, "3) A5(A;i2, tti, ^2, as) 



as 



A4(/i;3, ^12, ai, a2, as) A3(/c3, ai, as) 



The sum of the 15 amphtudes Eq. ( |A.3| ) is convenient to spht up into 9 terms. 



15 



r 



where matrixes 5"*^*'' are related to T^'^ in ( |A.8| ) as, 



^ 2^(2) 
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Sir) 
5(8) 



7^(7) . 5'(4) ^ y(8) . 

j.{9) . ^(6) ^ j.{10) . 

2 V 



2^(14) 



5'(9) ^ 2^(15) 



(A.19) 



The matrixes Mi can be represented in the following form using relations ( |A.16 ), ( A.19 ) 



Ml 



My 



Ms 



Mq 



"1 z>i(fci, ai) A;23, ai, ^2, "3) - hs - as^T, "i, "2, "s) 



+ a2a3 



- \i{ki - kT,k23, 0:1,02,03) Pi{k23,a2,a3) ; 



(A.20) 



+ 



+ 



"2 [^2(^2, fci3, "2, "1, "a) - ^2(^2, ki3 - 03kT, oi, 02, as)] i>2{k2, 02) 
ai03 P2{ki3, ai, 03) \2{k2, ki3, 02, oi, 03) 
\2{k2 - kr, ki3, oi, 02, 03) 

01 vi{ki, oi) piiki, k23 - as^T, "i, "2, "3) 
P'i{ki,k23 + a2kT, 01,02,03) ; 

02 ix2{k2,ki3- 03kT, 02,01,03) 
P'2{k2, ki3 + oikr, oi, 02, 03) i>2{k2, 02) ; 
02^3 Ai(fci - /ct, ^23, "1,02,03) 

>^i{ki - OikT,k23, 01,02,03) Pi{k23, 02,03) ; 

O1O3 P2{ki3, Oil, O3) \2{k2 - kx, ki3, Oi, O2, O3) 

A2(A;2 -a2fcT, fci3,ai,a2,a3) ; 

03 (j){k3, oi, 02, 03) uj{k3, ki2 + oikr, "i, "2, "3) 
'^{k3,ki2 - a2kT, 01,02,03) ; 

- 03 (f){k3, oi, 02, 03) u{k3, ki2 + oikx, Oi, 02, 03) 

^{k3, ki2 - 02kT, Oi, O2, O3) - 2 Uj{k3, ki2, Oi, O2, O3) 

Pih, ki2, oi, 02, 03) - (3{k3 - kx, ^12, "i, "2, "3) 



(A.21) 



(A.22) 



(A.23) 



(A.24) 



(A.25) 



(A.26) 



(A.27) 
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X 7(^i2,ai,a2,a3) 



(A.28) 



The following notations are used here, 

z>i(fci,ai) 



/il(fcl,fc23,ttl,tt2,a3) 



Ai(/ci, A;23,ai,a2,a3) 



Pi(A;23, 02,03) 



z/2(A;2,a2) = — -p -; (A.29) 

Ao(/c2,a2) 



Vl(fc23,Q2,Q3) 

Ai(/i;i,A;23,ai,a2,a3) 



. f ^ 1/2(^13, tti, "3) on^ 

/i2(«;2,fci3,«i,«2,a3) = ^ -; (A. 30) 

Ai(fc2,A;i3,ai,a2,a3) 



Aiih, hs, ai, a2, as) 



\ (T r ^ ^2(^2,^2) on 

A2(«;2,fci3,ai,a2,a3) = . ,r r 7' (A. 31) 

Ai(fc2,A;i3, 01,02,03) 



Vl(fe23,«2,«3) 
A2(/C23,a2,a3) 



. /f ^ V2(fci3,ai,«3) 

P2(/ci3,ai,a3) = -—7 -; (A.32) 

A2(A;i3, 01,03) 

(3{k3, ki2, oi, 02, 03) = ; (A. 33) 

A4(/i;3,fi:i2,ai,a2,a3) 

7(A;i2, oi, 02, 03) = -—^ ; (A.34) 

A5(/i;i2,ai,a2,a3) 

-(T r \ ^0(^12, Qi,Q2) 

uj[ks, ki2, oi, 02, 03) = ^ ^ ; (A. 35) 

A4(k3,«;i2, 01,02,03) 

0(4, ^2, Oi, 02) = ^ J;^"*-^^-* — ^ ; (A.36) 

A3(fc3, 01,03) 



Apparently, the amplitude operators in Eqs. ( [A.20| )-( [A.28| ) vanish, in forward direction. 



kx ^ 0, what guarantees infra-red stability of the cross section of gluon radiation. 
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The above relations are valid at any values of ai, 02, 03, however they substantially 
simplify if the momentum fraction carried by the radiated gluon is small, 03 ^ 1 what 
corresponds to th dominant configuration for a fluctuation G ccG. In the limit as ^ 
the amplitudes Mi, M2, M5, Mg, M7 and Mg vanish. Also the operators Vi,2 do not depend 
any more on the spin matrix a and become proportional Vq 



Vi{k23 + d2kT,a2,a3] 
V2{ki3 + aikT,ai,a3] 



03^0 

^3^0 

03— >0 



-alVoik) ; 
-ajVoik) ; 
-alVo{k - kr) ; 
-alVoik-kr) . 



Also the matrixes U12 oc Uo, 



Ui{ki,ai) 
U2{k2,a2) 



03^0 



03^0 



f/o(^i2 + aikT,ai,a2) ; 
Uo{ki2 - a2kT,ai,a2) • 



Besides, ai + 02 = cts ~ 1 and the denominators Aj take the simple form. 





Ao(fci,«i) 


03- 


->0 


= ml + kl 


— a\a2 y? 




Ao(/c2,ai) 


03- 


-♦0 


= ml + kl 


— oi\OL2 y? 


A5(A;i2 


Oil, 0(2, 013) 


03- 


-+0 


= ml + kl^ 


— a\a2 y? 


Ai(/Ci, k23 


ai, a2, as) 


03- 


-+0 


= (X2OLI 


kl 


+ r\kl)_ 


Ai(A;2,^i3 


0:1,0:2,03) 


03- 


^0 


= aia\ 


kl 


+ r\kl)_ 


A4(A;3, A;i2 


Oil, 0(2, 0:3) 


03- 


-+0 


= 0L\a2 


kl 


+ r\kl2) 



where 



T\k) 



0:3 

aia2 



[ml + + X' 



(A.37) 



(A.38) 



(A.39) 



(A.40) 



We keep the term linear in 03 in ( |A.40| ) since it is responsible for suppression of gluon 
radiation with 



"3 ^ 



2^ 

Ml 
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(A.41) 



where 



ml + kn 



aa 



(A.42) 



is the invariant mass squared of the cc pair, and 



ki2 = aki — ak2 . 



(A.43) 



The approximation 0:3 <^ 1 is justified even for gluons satisfying the condition Eq. ( |A.41|) , 
since 

(A.44) 



\2 ^2 

-— ~ ~ 0.005 

Ml 4 m? 



Further, we will make use of the relations. 



ki = ki2 + a{kT - k^) + 0(03) 
k2 = ki2 + a{kT - h) + 0(0:3) 



(A.45) 



where a = ai, and also take into account that both kx and k^ are of the order of A, i.e. 
they are much smaller than the typical values of ki2 ~ m^. Therefore, we will rely on the 
relations, 

T^iki) ^ T\k2) ^ T\k^2) ^ = + 03 Ml . (A.46) 



Within this approximation the amplitude of reaction GN cc G X at 0:3 ^ 1 is given by 



• 3/2 fbdeF^N^xikrAx}) .^t J ^o(fci,a,a) 



e4=l 



H + A2 



Uo{-k2,a,a) , . . ?7o(A;i2, «, a) , 
fc| + mi ki2 + mi p{ 



k\ + mi 



aeg \Tg)ij 



2ef ■ (/cg - kx) 2 6/ ■ 4 



(A.47) 



(A;3 - kry + r2 k1 + 
To switch to the impact parameter representation we should perform Fourier integration 
over momenta ku, kx and k^. This procedure turns out to be quite complicated because of 
the dependence of r in ( |A.46|) on the invariant mass Eq. ( A.42 ) which involves k^. For the 
sake of simplicity we replace in Eqs. (|A.46|) - (|A.47|) the invariant mass of the cc pair by its 
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mean value, M£. =^ M|, = N Ami, where ~ 1 — 2. Then Eq. ( A. 47 ) can be represented 
in the form, 



N^-l 



^if,ab = 3« XI fbde / (^^r (f p (f s exp(i ku-f+ik^-p + ikT-sj 



e4=l 



X ^'^'^(f, a) |$cg(p + ar) (r„re)i, [7^ HP + - 7^ - «r) 
- $cg(p - af) {T,Ta)ij [l^'^\p + s) - 7^^) (s + af) 



(A.48) 



where f, p and s are the inter-quark separation, gluon - cc separation, and the position 
of the center of gravity of the whole ccG system, respectively. The cc LC wave function 
\l/^'^(f*, a) and the profile function 'j^'^'>{s) are defined in ([TT|) and (^), respectively, and 



2? /TV 

<^>cg(p1 = e; ■ V, Mrp) 

TTVO 



(A.49) 



Further, note that the mean cc separation ~ 1/ rric is much smaller than the typical scale 
~ 1/A ~ 1/Aqcd ~ 1 fm of variation of the profile function 7'''^''(s). Therefore, we can 
neglect the r-dependence of 7*^"^^ in ( |A.48| ), i.e. replace 



(A.50) 



After replacing the bilinear to linear combinations of r-matrixes in ( |A.48| ) by means of 
relation 

1 1 ^'-^ 

ija'Te)ij = '^^ae^ij + 'Z ^ (c^aeg + ifaeg) {.'^g)ij i (A. 51) 

" ^ 9=1 

we arrive at the final result of this section, 

4>6 = 3^ E fbde / dhSpdhexv[iki2-r + ih-p + ikT-s) [i^''\p + s) - ^'^''\s) 

e,d=l 
1 



g ^ae^ij + 2 E daeg{jg)ij 



^-ccir.p) + - Y.faegiTg^.^tcir.p)'^ ■ (A.52) 
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Here 



(r , p) = (p + a r) + (p - af) - 2 <I>,g (p) • (A.53) 



The three terms in curly brackets in Eq. (|A.52|) describe production of the cc pair in 
different color and spin states. The first term containing 5ae^ij is responsible for production 
of a colorless cc with positive C-parity. Since C-transformation cannot be applied to colored 
states, instead we use parity relative to interchange of the c and c quarks., which is negative 
for this state. Therefore we classify this colorless state as 1^ (1 means color singlet). The 
second and third terms in ( |A.52|) containing Y,daeg{jg)ij and faeg{jg)ij correspond to 

9 9 

production of color-octet cc, 8~ and S"*" respectively. 

Note that the cc pair can be also produced in a colorless state l"*", i.e. with negative 
C-parity. This is not forbidden in the process GN — > ccGN by selection rules, like it 
happens in reaction GN —>■ ccN, but is suppressed dynamically. Indeed, it turns out that 
the production amplitude is proportional to ac, therefore it can be neglected in the limit 
of ^ 1 we are interested in. 



As it was first pointed out in [|T7| the nonperturbative interaction between the gluon 
and the cc pair in the |ccG) Fock state may significantly modify the LC wave function of 
this state. Therefore, one should replace the perturbative wave functions Eq. (|A.49|) by the 



nonperturbative ones ||T^. Apparently, the result will depend on the strength of the LC 



potential which should be different for the three different states of the cc pair discussed 
above. 

According to the approximation accepted above that the distance between the gluon and 
the center of gravity of the cc pair is much larger than the the pair itself, the combinations 
Eq. ( [A.53| ) of the wave functions may be approximated as, 

<l>+.(r,p) ^ (2a-l)f-V,$eG(p) • (A.54) 
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